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ABSTRACT 

We consider the weight design problem for the consensus al- 
gorithm under a finite time horizon. We assume that the un- 
derlying network is random where the links fail at each itera- 
tion with certain probability and the link failures can be spa- 
tially correlated. We formulate a family of weight design cri- 
teria (objective functions) that minimize n,n — 1, ...,N (out 
of N possible) largest (slowest) eigenvalues of the matrix that 
describes the mean squared consensus error dynamics. We 
show that the objective functions are convex; hence, globally 
optimal weights (with respect to the design criteria) can be ef- 
ficiently obtained. Numerical examples on large scale, sparse 
random networks with spatially correlated link failures show 
that: 1) weights obtained according to our criteria lead to sig- 
nificantly faster convergence than the choices available in the 
literature; 2) different design criteria that corresponds to dif- 
ferent n, exhibits very interesting tradeoffs: faster transient 
performance leads to slower long time run performance and 
vice versa. Thus, n is a valuable degree of freedom and can 
be appropriately selected for the given time horizon. 

Index Terms — consensus, weight design, convex opti- 
mization, time horizon, correlated link failures 

1. INTRODUCTION 

We consider the design of the weights for the consensus algo- 
rithm under a finite time horizon. We assume the network is 
random with links failing at each iteration with certain prob- 
ability (see also |[T1|2][3]). The link failures are temporally 
uncorrected but can be spatially correlated, which is a bet- 
ter suited assumption for wireless sensor networks (WSNs) 
than spatially uncorrected failures. Reference |4| optimizes 
the weights for static network topologies. The weight design 
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in im leads to a convex problem of maximizing the algebraic 
connectivity of the (weighted) graph Laplacian with respect to 
the weights. In [5|, we showed that the weight optimization 
for random network topologies can be cast as a convex opti- 
mization problem. In this paper, we consider also the weight 
design for random topologies, but here consensus is over a fi- 
nite number of iterations, i.e., under a finite time horizon. 
This problem is of interest in WSNs, where the number of 
iterations available can be limited to a small number due to 
the small power budget of sensors. Also, in certain applica- 
tions, e.g., distributed detection of critical events (e.g., fire), 
result must be provided within certain critical time. Weight 
design with finite time horizon requires a new approach, dif- 
ferent than |5|, since it must account for the transient phase 
of the consensus algorithm. We first explain our methodol- 
ogy for solving the problem on static networks; we show that, 
under a finite time horizon of k iterations, not only the slow- 
est mode, but all the modes of the consensus error dynamics 
should be taken into account. This leads to the formulation 
of a family of convex objective functions, indexed by n, that 
minimize the sum of the n largest eigenvaules that correspond 
to the n slowest modes, ti = 1, iV, of the error state ma- 
trix. We generalize all the results to random networks with 
spatially correlated links. We show that the objective func- 
tions are still convex for random topologies. Hence, globally 
optimal weights (with respect to the defined criteria) can be 
efficiently obtained by numerical optimization. The weight 
design |5] is a special case of the functions family proposed 
here when n ~ \. Numerical examples on sparse, large scale 
networks with spatially correlated link failures show that: 1) 
the weights from our design family lead to significantly faster 
convergence than the available choices in the literature; 2) 
different choices from our family (that correspond to different 
choice of n) exhibit very interesting tradeoffs: better transient 
performance leads to worse time asymptotic performance and 
vice versa. Thus, depending on the given time horizon, one 
can choose the appropriate cost function (i.e., n) to achieve 
the desired performance. 



2. PROBLEM MODEL 

We follow the model of a random network as in |6|, except 
that we assume that the links can be spatially correlated, while 
in ||6l they are uncorrelated. We briefly introduce relevant ob- 
jects and notation. The supergraph G = (F, E) is the graph 
that collects all the links with non zero probability of being 
alive. {V is the set of nodes, and E is the set of undirected 
links.) At any time step k: 1) link {i, j} € i? is active with 
probability _Py ; 2) link r, incident to nodes i and j, and link s, 
incident to nodes I and m, are correlated with the correspond- 
ing cross variance Rrs- Consensus is an iterative distributed 
algorithm that computes the average Xavg = X^i^i of 
scalar sensor measurements (or some other data) Xi (0) itera- 
tively at each sensor i: 



x,(fc+l) = 1 - V W,,{k) x,(fc)+ V W,j{k)x^{k) 



(1) 

In ([T]), Oi denotes the neighborhood set of sensor i, i.e., 
Oi = {j : {i,j} e E}. Defining the state matrix >V(fc) = 
[yVij(fc)] and the state vector x{k) — (xi(fc), XAr(/c))"^ 
we have in compact form: x{k + 1) = >V(fc) x{k). Also, it 
is straightforward to show (e.g., f4l) that the consensus error 
e{k) — x{k) — Xavg 1 follows the dynamics: 



e{k + l) = {W{k) 



J)e{k), J= ^11^ 



We consider the case when Wy(fc), {i, j} G E, is equal to 
a prescribed number Wij whenever link is alive and 

zero otherwise. Thus, 'Wij{k) is a binary random variable 
for e E {Wij{k) = if i E). We design the 



weights {W,j} = {Wij e 



e E, i < j} that 



lead to fast average consensus under a finite time horizon. We 
define a family of convex objective functions (criteria) that 
lead to fast consensus in random topologies. We first explain 
our methodology in the context of a static topology (section|3]l 
and then consider correlated random topologies (section|4]i. 

3. STATIC TOPOLOGY: MOTTVATION EXAMPLE 

We consider first that the network is static. Then, the state ma- 
trix yy(fc) =Wk deterministic and is given by: Wij = Wij, 
e E- = 0, {i,]} i E; W,, = l-E,GO. W^j. We 
compute the eigenvalue decomposition of the matrix W ~ J, 
W ~ J — QAQ^, where the eigenvalues are ordered such 
that |Ai| > IA2I > ... > IAatI = (Aat = since Wl = 1 
and Jl = 1.) A necessary and sufficient condition for the 
consensus algorithm ([TJ to converge is that |Ai| < 1 ||4|. The 
consensus error can be written as: 



N-l 



N-1 



Weight optimization for static topology has been studied 
in f^. This reference proposes two different criteria (objec- 
tive functions) to optimize the weights, the time asymptotic 
convergence rate and the worst case per step convergence 
rate rgtcp defined as: 

ra. = sup lim (|le(fc)|l/|le(0)|l)^/'= 

r,tep = sup |le(fc + l)||/||e(fc)|| 

Since the matrix >V — J is symmetric, we have that r^s = 
^'stop = I All, iH). Thus, Tas and rgtcp both map to the mini- 
mization of I All with respect to the weights {W^j^}. This is a 
convex optimization problem |4|. 

We argue that for small k and for the optimal average 
performance, rather than the worst case performance, a cri- 
terion for minimization different than |Ai| should be consid- 
ered. We give a motivational numerical example by consid- 
ering a (static) connected network with iV = 120 nodes and 
M — 449 edges. Figure 1 plots ||e(fc)||^ averaged over 1000 
different random initial conditions for two different weight 
choices: 1) the weights that minimize |Ai|; 2) the Metropolis 
weights (MW), |1 1. Metropolis weights are a heuristic weight 
choice and thus not optimal. However, in first 20 iterations, 
MW performs better. The reason is that minimization of |Ai| 
causes several other eigenvalues of W — J to be close in mod- 
ulus to Ai. Eqn. (|2]i clearly shows that, for a small number of 
iterations fc, all nonzero eigenvalues A^ affect the error (since 
for small k Xf' are not negligible, i = 1, N — 1 ). Thus, 
for small k, it is better to have many eigenvalues of >V — J 
small in modulus than to minimize | Ai | at the cost of having 
large A2, A3, .... In order to make all modes Q{k) (eqn. (|2]l) 
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Fig. 1. Squared error versus iteration k for static network. 

small, we propose to minimize the sum of the squares of the 
eigenvalues Ai, i.e., to minimize the function tpN {{Wij}) := 
SiLi^ = {{W — J)^). Further, we may reason as fol- 
lows. For k being very large, only the largest eigenvalue is of 
interest; for k being very small, all the eigenvalues should be 
taken into account. For some medium range of the number 



of iterations, it is reasonable to try to minimize the n largest 
eigenvalues of [W — J)^,l < n < N. This leads to the min- 
imization of function tjjn {{Wij}) :— X]"=i '^f ' i-^-' '^he 
following optimization problem: 

minimize tpn {{Wij}) 
subject to W^j e M, {i,j} e E (3) 
|Ai|<l 

The constraint |Ai| < 1 assures that we search only over the 
weight choices for which the consensus algorithm converges. 
It can be shown (the proof is omitted here) that the functions 
'0n(')' JT- = 1, — 1, are convex, and thus ([3| is a convex 
problem. 

Lemma 1 The function ipn {{Wij}) is convex for any n = 
1,...,7V-1. 

4. CORRELATED RANDOM TOPOLOGY 

We generalize the results from the previous section to the case 
of random network topology with spatially correlated link 
failures. Reference |5| studies the weight design for corre- 
lated random topology. Denote the consensus error covari- 
ance matrix by T,{k) = E [e{k)e^{k)'\. It can be shown 
that 13: 

tr(E(fc + l)) =tr(E(fc) (E[>V2] - J)) (4) 

Reference |5| minimizes {{Wi^}) = Ai (E [W^] - j). 
This quantity represents: 1) the worst case per step mean 
squared rate of convergence (eqn. (|5]l); 2) the upper bound 
on the time asymptotic convergence rate (eqn. (|6]l), see |7|: 

E[e(fc + ire(fc + l)] 

E[e(fc)e(fc)r]^0,E[e(fe)re(fe)]5^0 -Cj [e(fcj e(fcjj 

Define the function 

n 

4>n {{W,,}) = ^^ (E [W'] - J) . (7) 

i=l 

We remark that ) for random topology boils down to 
ipi{-) for static topology. Thus, minimization of (fii boils 
down to minimization of |Ai(W — J)| if the network is 
static. The same holds for the functions 0„(-) and tlJn{-), 
n — 2, N — 1. This is because the matrix E [W^] — J is 
simply the matrix — J — (W — J)^ when the network is 
static. Thus, we propose to solve the following optimization 
problem: 

minimize 0„ ({W^y}) 

subject to Wij G M, {ij} £ E (8) 
01 {{W,,}) < 1 



Constraint (pi ({Wij}) < 1 restricts the search only over 
the points {W^^j} for which the algorithm converges in mean 
squared sense. Special case n = 1 is studied in 1,5J. We have 
the following result: 

Lemma 2 The function 4'7i{{Wij}), n — 1, — 1, w 
convex. 

The proof of Lemma 2 for n= 1 is in 1 5 1, but we extend it to 
the case of arbitrary n, n = 2,...,A^— 1. Due to lack of space 
it is omitted. In view of Lemma 2, optimization problem ([HJ 
is convex; hence, globally optimal {Wij} can be efficiently 
obtained. 

5. SIMULATIONS 

We consider a sparse geometric supergraph with = 120 
nodes and M — 449 edges. Nodes are uniformly dis- 
tributed on a unit square and the pairs of nodes with dis- 
tance smaller than a radius r are connected by an edge. We 
define the formation probabilities by the following model: 
= 1 - ci {5ij/rf, {i, j} c E, ci ^ 0.6. . Link r, 
incident to nodes i and j, and link s, incident to nodes I 
and TO (and Pij < Pim) are correlated at time fc; the corre- 
sponding cross-variance is given by Rrs — C2 Pij (1 — Prs), 
C2 = 0.2. The correlated binary random links are simu- 
lated by the method in |8|. We compare the performance 
of our solutions with the weight choices for random topolo- 
gies previously proposed in the literature, namely with the 
Metropolis weights [1|, and the weights proposed in fT), 
which we refer to as the supergraph based weights (SGBW). 
Figure 2 plots the mean squared error averaged over 100 dif- 
ferent initial conditions. We compare the following weight 
choices: 1) MW; 2) SGBW; 3) weights obtained by mini- 
mizing 01 (which also appear in |5|); 4) weights obtained 
by minimizing 030. Numerical minimization of (|8]l is done 
by the subgradient algorithm for constrained minimization: 
if the current point {Wij} is feasible (0i ({Wij}) < 1), we 
compute the subgradient step in the direction of the objec- 
tive function 0„; 2) if the current point {Wij} is infeasible 
(01 ({Wij}) > 1), we compute the subgradient step in the 
direction of 0i (constraint function). Figure 2 (a) shows that 
both 01 and 03o outperform SGBW and MW. To decrease the 
error to 1%, 0i takes around 44 iterations; 03o takes 37 itera- 
tions; SGBW and MW take more than 75 iterations to achieve 
1% precision. We see that 0i and 03o exhibit a tradeoff: in 
the transient regime (i.e., for small iterations k), 03o performs 
better; for large fc, 0i performs better. For the precision of 
1%, 030 is a better choice (it saves 7 iterations compared to 
01, see also Figure 2(b)); for the precision of 0.1%, 0i is a 
better choice (it saves around 15 iterations compared to 03o) 
(see Figure 2(a)). Figure 2(b) presents the performance for 
3 different choices of n, n = 1, n = 15, n = 30, in initial 
50 iterations. We see that, for the 1% precision, 0i5 reduces 
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(a) Comparison of and 4>i with MW and SGBW 
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(b) Tradeoff in choice of 0i, 4>i^, 4>zo 

Fig. 2. Random network: mean squared error versus iteration 
number averaged over 100 random initial conditions. 

by 25% the number of iterations compared to 0i, from 43 to 
33. Possibility of choosing different n is valuable in practice. 
One can envision the application of the family {0„}, for in- 
stance, in tracking applications, where combined technique 
of detection and estimation is used. In the first phase of track- 
ing, target should be detected roughly in an area. This task 
can be done by distributed detection using consensus algo- 
rithm ||9l. For this task, by nature of problem, high precision 
is not required, and thus one should choose (/!)3o criterion for 
fast solution. In the second phase of tracking, target trajec- 
tory is estimated, which can be done distributively based on 
consensus algorithm fV\. This task requires higher precision. 
For this phase, one could choose 0i or (^15. 

6. CONCLUSION 

In this paper, we studied the weight design for a finite time 
horizon consensus with random topology and spatially corre- 
lated link failures. We addressed the problem of finding the 
optimal weights that yield the best average performance of 



the algorithm. We consider a finite time horizon, i.e., only a 
limited number of consensus iterations is available. We for- 
mulate a class of optimization problems for weight design 
under a finite time horizon. This class minimizes the sum 
of the n largest eigenvalues of the matrix that describes the 
mean squared error dynamics , n — 1, N. We show that 
the optimization problem is convex for arbitrary n and hence 
can be efficiently globally solved. Numerical examples on 
large scale, sparse graphs with spatially correlated link fail- 
ures show that, for any choice of n, optimization provides 
solutions better than the weight choices previously proposed 
in the literature. Also, the weight optimization for finite time 
consensus leads to very interesting tradeoffs: larger n yields 
faster convergence in the transient regime and slower conver- 
gence in the long run regime. The parameter n represents a 
valuable degree of freedom than can be appropriately set for 
given time horizon. 
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